Comparisons of binary black hole merger waveforms 
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This a particularly exciting time for gravitational wave physics. Ground-based gravitational wave 
detectors are now operating at a sensitivity such that gravitational radiation may soon be directly 
detected, and recently several groups have independently made significant breakthroughs that have 
finally enabled numerical relativists to solve the Einstein field equations for coalescing black-hole 
binaries, a key source of gravitational radiation. The numerical relativity community is now in the 
position to begin providing simulated merger waveforms for use by the data analysis community, 
and it is therefore very important that we provide ways to validate the results produced by various 
numerical approaches. Here, we present a simple comparison of the waveforms produced by two 
very different, but equally successful approaches — the generalized harmonic gauge and the moving 
puncture methods. We compare waveforms of equal-mass black hole mergers with minimal or 
vanishing spins. The results show exceptional agreement for the final burst of radiation, with some 
differences attributable to small spins on the black holes in one case. 

PACS numbers: EDIT 04.25.Dm, 04.30.Db, 04.70.Bw, 95.30.Sf, 97.60.Lf 



The intense gravitational radiation produced by merg- 
ing black-holc-binaries is expected to be among the 
strongest gravitational waves produced by astrophysical 
systems, and may even be detectable by the current gen- 
eration of gravitational wave observatories, such as initial 
LIGO [1] (which is already taking data at its designed 
sensitivity). However, any detection with the current 
instruments is likely to be at a low signal-to-noise ra- 
tio, and therefore having accurate information about the 
predicted waveforms will increase the observers' ability 
to discern the signals from noise, effectively increasing 
the likelihood of an identifiable detection. For the more 
sensitive instruments to come, including advanced LIGO, 
and the space-based Laser Interferometric Space Antenna 
(LISA) observatory [2| , better knowledge of the waveform 
predictions from General Relativity will increase the pre- 
cision with which source parameters (i.e. the masses and 
spins of the components and the eccentricity of the their 
orbit) can be identified from the waveform, and will make 
high-precision tests of General Relativity in the strong- 
field regime possible. 

Recently several groups have independently made sig- 
nificant breakthroughs jl, 0, [BJ in solving the Einstein 
field equations for coalescing black-hole binaries. Each 
of these groups were able to simulate the entire merger 
phase for various black-hole-binary configurations and 
accurately calculate the resulting waveforms. The nov- 
elty of the new techniques, however, leaves some room 
for questions of whether the results might be influenced 
by modeling errors that were not evident in the context 
of an individual research group's effort. In this paper we 



compare the recently published results of three groups, 
which have each independently solved the problem of how 
to successfully evolve black-hole-binary systems through 
the last orbits, merger, and ringdown to extract the grav- 
itational radiation. Each of these groups has performed 
simulations of s yste ms of equal-mass black hole merg- 
ers d 0, H S, IH with the UTB and GSFC groups 
studying non-spinning irrotational binaries, while Pre- 
torius applied a corotational binary model, implying a 
small spin a/m = 0.08 on each of the individual black 
holes. All simulations went through between 1.75 and 
2.5 orbits before merger. Each of the groups has gone 
to some effort to demonstrate the quality of their wave- 
forms, giving at least a rough estimate of the level of error 
in their simulations, but comparing the results gives us 
a more comprehensive understanding of the full range of 
modeling uncertainties. 

If we look at waveform predictions as a modeling pro- 
cess, it is clear that there are several different classes of 
potential errors roughly associated with different steps 
in the modeling process. A first step is to pose initial 
data describing the configuration of the black holes at 
some point a few orbits before merger. In our com- 
parisons, no attempt is made to fix the starting point 
of the simulations. Rather, we will look for agreement 
among the runs for the portion of the merger covered 
by all simulations. The runs shown here begin with a 
variety of initial data models. Pretorius uses the Cook- 
Pfeiffer [llj, ll2| technique to generate quasi-circular data 
using the conformal-thin-sandwich decomposition with 
excised horizon interiors. The GSFC and UTB groups 
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use the Brandt-Briigmann puncture approach [l3j to gen- 
erate the initial data (which, in turn, is based on the 
Bowen-York [l4| ansatz for the extrinsic curvature). The 
GSFC and UTB approaches are distinguished by their re- 
spective choices of normalization and the methods used 
to determine the free initial data parameters. The GSFC 
group obtained values for the puncture positions and mo- 
menta from the Cook initial data sequence |l5] . The 
UTB group, on the other hand, used the 3PN trajecto- 
ries of quasi-circular binaries with an orbital period of 
Mui = 0.050 and total mass Madm = 1 to determine 
the puncture positions, mass parameters, and momenta. 
The two choices of parameters turn out to be very simi- 
lar; differing by less than 1% after re-normalizing to unit 
mass (the overall scaling is not important here because 
the waveforms will be rescaled by the final mass of the 
remnant). 

The question here is how sensitive the waveform re- 
sults are to variations in the initial data model. While it 
has not been straight forward for the groups individually 
to compare puncture models with Cook-Pfeiffer data, it 
is possible for each group to study initial data sensitiv- 
ity within the class of initial data they are using. This 
has been addressed by the GSFC group by performing a 
range of simulations varying from the one presented here, 
to a four orbit run. Their simulations showed excellent 
agreement at roughly a 1% level beginning about 50M 
before the peak of merger radiation and onward. Prior to 
this late merger part of the waveforms, their waveforms 
showed rough agreement with variations that seemed to 
be associated with eccentric motion in the binaries that 
depended on the specifics of the initial data parameters 
for each run. Similar estimates of the intrinsic differences 
in Cook-Pfeiffer initial data sets were presented in @ by 
evolving three different initial separations. Good agree- 
ment was also found near the peak of energy emission, 
though given that the corotation condition gave the ini- 
tial black holes spins of 0.06, 0.08 (the simulation exam- 
ined here) and O.f f, the agreement is not expected to be 
as close as the GSFC results. 

All three approaches used conformally flat initial data. 
These data contain a short burst of spurious radiation 
that quickly leaves the system. The amplitude of this 
spurious signal decreases monotonically as the initial bi- 
nary separation is increased and does not appear to alter 
the binaries waveform in a significant way after the pulse 
is radiated away. 

The next, crucial stage in the modeling is to perform a 
numerical simulation of the merger dynamics. Pretorius' 
evolutions were performed using a generalized harmonic 
evolution scheme [l6[ with constraint dampin g [i~7 1 . B oth 
the UTB and GSFC groups use the BSSN 0, M [H 
system of equations in conjunction with a 1 + log type 
lapse and T-driver shift conditions. The UTB method dif- 
fers from the GSFC method in that the standard BSSN 
conformal exponent (which has an O(logr) singular- 
ity at the punctures) is replaced by the initially C 4 field 
X = exp(— 40), and by a different choice for the precise 



form of the gauge conditions. The GSFC and Preto- 
rius simulations took advantage of Adaptive Mesh Refine- 
ment, to allow a distant outer boundary without reducing 
resolution near the black holes, while the unigrid UTB 
simulations used a 'multiple transition' fisheye transfor- 
mation Q to push the physical boundaries to 216-Madm 
(simulating FMR). 

The final modeling step is to determine gauge invari- 
ant waveform information from the simulation data that 
represents the gravitational wave signal seen by distant 
observers. This is complicated by the fact that typical 
simulations require the radiation information be mea- 
sured from the simulation data at relatively small dis- 
tances from the sources in comparison to the far larger 
distances between earth-based observers and astrophys- 
ically realistic merging binaries. Again our groups have 
taken different approaches to this task. Working alone 
a group can quantify error levels by comparing wave- 
forms extracted at different distances from the sources 
and by comparing the radiated energy and angular mo- 
mentum with the mass and angular momentum differ- 
ences between the remnant black hole mass and angular 
momentum and the ADM mass and angular momentum. 
In particular, the deviation between this mass difference 
and the radiated energy is a measure of the amplitude 
error in the waveform, while the deviation between this 
angular momentum difference and the radiated angular 
momentum is a measure of the phase error in the wave- 
form as well as the amplitude error. 

The UTB group used both the coordinate-based [2l[ 
and the quasi-Kinnersley 0, [H| tetrads to define ip4 
(both extracted at r — 30M), and found no significant 
difference in the dominant (£ = 2, to = ±2) modes for 
the two choices of tetrads. The coordinate-based tetrad 
is equivalent to the Kinnersley tetrad for Schwarzschild 
spacetimes, but the resulting Newman-Penrose "04 con- 
tains contributions from the Kinnersley -00 — ^3 for 
spacetimes with spin. The quasi-Kinnersley tetrad re- 
moves this type of mixing but leaves overall phase and 
amplitude ambiguities in ip4. However, the good agree- 
ment between the radiated angular momentum and mass 
and the angular momentum and mass losses of the rem- 
nant black hole indicate that these amplitude and phase 
ambiguities are small for the (£ = 2, to = ±2) modes. 
They verified the accuracy of the waveforms that they 
produced by evolving the binary with three resolutions 
and measuring the deviation in the waveforms between 
resolutions. They also confirmed that the radiated mass 
(3.5±0.f )% and angular momentum (27±1)% calculated 
from the waveform in their simulations matched the mass 
(3.5 ±0.1)% and angular momentum (26.9 ±0.3)% losses 
of the remnant horizon. The uncertainties in the radi- 
ated mass and angular momentum arise from extracting 
these quantities at finite distances and extrapolating to 
infinity. The uncertainty in the waveform due to finite 
resolution is quite small. After translating the waveforms 
so that the maximum amplitudes coincide and correct- 
ing for the phase differences at this maximum, they find 
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that the plunge part of the waveforms differ by ~ 0.25% 
between resolutions of M/22.5 and M/27, while the late- 
time ringdown part of the waveforms differ by ~ 1.4%. 
The radiated energy and radiated angular momenta dif- 
fer by 0.7% and 0.2% respectively. 

The GSFC waveform simulations were carried out at 
three resolutions with finest-grid resolutions of hf £ 
{3M/64,M/32,3M/128}. At second-order convergence, 
the difference between these two higher resolution sim- 
ulations provides a estimate for the error of the higher- 
resolution run. The peak wave amplitudes for these runs 
showed agreement to ~ 0.5%, with differences of < 1% 
in the waveforms overall after shifting to align the peaks. 
The GSFC waveforms were extracted using a coordinate 
based tetrad, as in [2l[ , but extractions were carried out 
on larger spheres r/M 6 {20,30,40,50}. Results from 
both higher-resolution runs including the three extrac- 
tion radii with r > 30M indicate consistent results for 
the radiative losses of energy (3.44 ± .01)% and angular 
momenta (26.0±.3)%. In the comparisons we show wave- 
forms from the hf = 3M/128 run extracted at r — A0M, 
which strikes a good balance between 1/r effects too 
close in, and numerically induced dissipation as the waves 
propagate farther out. 

In the generalized harmonic code waveforms were also 
extracted using a coordinate based tetrad at extraction 
radii from r = 13Af through r = 51M, as described in Q. 
Convergence tests at an extraction radius of r = 51M 
suggest a maximum amplitude error of 9%, a maximum 
bare phase error of 0.7 cycles, a maximum phase error 
after time translation and rotation of 0.06 cycles, (4.3 ± 
0.4)% total energy radiated and (33±2.1)% total angular 
momentum radiated. 

We will compare the results of one run from each 
group. Table [J summarizes the runs compared here. As 
stated, the runs agree in mass ratio and have vanishing 
or small spins. As we construct our comparison, we will 
initially ignore the small difference in spins, though we 
will return, as we consider the comparative results. The 
other physical parameters, total mass, merger-time, and 
merger-orientation are unrelated among our runs. For- 
tunately, each simulation result can be viewed as repre- 
senting an equivalence classes of systems with different 
values for these parameters. Upon concretely simulating 
one member of the equivalence class, we can derive the 
others by suitable application of time-translation, rota- 
tion, and scaling operations. Our comparisons will focus 
directly on the strongly dominant spin-weighted spherical 
harmonic component of the radiation, the (£ — 2, m = 2) 
component (which is mirrored by the (£ = 2, m = —2) 
component). Following Refs. @, [24[ we will compare 
the simulations by rescaling masses by the final remnant 
black hole mass, applying a time-translation so that the 
time of peak waveform (polarization) amplitudes agree 
(labeled t = 0), and applying a rotation so that the 
waveform phases agree at t = 0. Note that a similar 
comparison method was introduced in Ref. (24l |. 

In Fig. [T] we show the real part of the (£ = 2, m = 2) 



TABLE I: Model Parameters for the three runs. r ex t is the 
radius of the waveform extraction sphere, rbdry is the location 
of the outer boundary, Madm is the total ADM mass of the 
system, Jadm is the total ADM angular momentum, S is the 
initial horizon spins, r is the initial orbital period, and I is 
the initial proper distance between the horizons. 
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mode of ip4 for the three different simulations after nor- 
malizing the waveform by the final remnant mass, rescal- 
ing the i-axis by the final remnant mass, translating the 
waveforms so that the maximum amplitude is centered 
at t — 0, and multiplying by constant phase factors. As 
expected the UTB and GSFC waveforms are remarkably 
similar (i.e. they both start from essentially the same 
configuration), while Pretorius' waveform shows a higher 
frequency consistent with its larger spin. Note that the 
initial data pulse evident in the inset is smaller for Preto- 
rius' waveform. This is mainly due to Pretorius' simula- 
tion starting from further separated binaries. The UTB 
and GSFC runs differ most strongly (but by less than 3% 
of the amplitude) at the peak of the waveform. Small dif- 
ferences in the UTB and GSFC waveform at the 0(1%) 
level are expected because the initial data were only in 
agreement to that order. In addition the GSFC and UTB 
waveforms were extracted at different radii r oxt , and the 
extracted waveforms contain an 0(l/r ext ) error. Note 
that the plunge behavior (—25 < t/Mf < 25) is in large 
part independent of differences in the starting configura- 
tion and initial spins (at least for small spins). This inde- 
pendence of the plunge waveform to small changes to the 
initial configuration is more pronounced in Fig. [2l which 
shows the instantaneous frequency of the (£ = 2, m = 2) 
mode of ipi versus time. While Pretorius' simulation 
shows a generally consistent waveform, especially during 
the plunge, the frequency is slightly higher than that de- 
termined for the more similar GSFC and UTB waveforms 
during both the initial orbital inspiral part of the wave- 
form and the late-time ringdown part of the waveform. 
We suspect that the differences may primarily be the ef- 
fect of spin on the black holes in Pretorius' initial data, 
which tends to result in higher frequencies in merger and 
ringdown [2^, [26|, [27]]. The relatively large oscillations 
observed in the UTB frequency profile at late times are 
due to boundary reflections, similar noise in the early 
part of the GSFC waveforms are caused by echos of early 
gauge dynamics off the AMR refinement interfaces. 

From the above results we can make several important 
conclusions. First, the plunge part of the waveform is 
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FIG. 1: The real part of the (I = 2, m = 2) mode of the grav- 
itational radiation waveforms from three different research 
groups. The waveforms from the strictly non-spinning GSFC 
and UTB runs show excellent agreement after t = — 50M/, 
while Pretorius' run rings-down at slightly higher frequency 
consistent with the corotating spins on the black holes. The 
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merger waveform significantly. Finally, the good agree- 
ment between these waveforms supports each individual 
groups claims of accuracy. On the other hand, our com- 
parisons also seem to indicate that the GSFC and UTB 
waveforms agree more closely with each other than with 
Pretorius' results which realize slightly higher frequen- 
cies. This difference is consistent with the small spins 
on the black holes in Pretorius' simulations. Note how- 
ever that the differences are in fact smaller than the con- 
servative estimates of the errors of the latter simulation 
presented in [f| . Further comparisons of runs with more 
closely-matched astrophysical parameters and higher ac- 
curacy (both in terms of truncation error and control- 
ling/understanding systematics) will be needed to verify 
that this is indeed the effect of astrophysical differences. 
Also, the comparisons presented here have been rather 
qualitative, and more rigorous, quantitative procedures 
will eventually be necessary — such a strategy was pro- 
posed in [28j, though the emphasis there was on quan- 
tifying the accuracy and differences in waveforms with 
respect to the data analysis effort, ft will be interesting 
to compare these waveforms, and those currently being 
produced by other groups, with this methodology. How- 
ever, given that visually the three waveforms shown here 
are more similar than the sample waveforms used in [28[ 
we can anticipate that the overlap of the waveforms in 
Fig. [1] will be greater than 0.95 for black hole binaries 
with masses greater than roughly 200 solar masses (see 
Fig.'s 2 and 8 in [H). 

The type of waveform comparisons illustrated in this 
paper will be facilitated by the NRwaves project [29| . 
which will contain a repository of waveforms produced 
by all participating numerical relativity groups. 
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FIG. 2: Gravitational radiation polarization frequencies from 
three different research groups. The UTB and GSFC wave- 
forms are very similar with the UTB result showing high fre- 
quency oscillation at late times due to boundary reflections. 
The consistently larger frequencies of Pretorius' waveform are 
apparent. 

a robust feature that varies little with either the bina- 
ries starting configuration or the component black hole 
spins (provided that the spins are small). Such univer- 
sality of the late part of the waveforms was shown in 
for a specific sequence of initial configurations with in- 
creasing separation. Our comparative results support the 
notion in a broader context. Second, the spurious radia- 
tion content of the initial data does not contaminate the 
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